# Long-text retrieval

M2-BERT-128 is an 80-million-parameter retrieval model checkpoint proposed in the paper 'Benchmarking and Building Long-Context Retrieval Models with LoCo and M2-BERT'

This is an 80M parameter M2-BERT pre-trained checkpoint with a sequence length of 2048, fine-tuned for long-context retrieval tasks.